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Abstract 

The 3-3-1 model, based on the gauge group SU (3) c x SU (3) l x U(1)x, makes 
a natural prediction of three generations based on anomaly cancellation. Since 
this is accomplished by incorporating the third family of quarks differently 
from the other two, it leads to potentially large flavor changing neutral cur¬ 
rents. A sensitive place to look for such effects is the flavor changing b —> sj 
decay, which has recently been measured at CLEO. We compute this decay 
rate in the 3-3-1 model and compare it with that of the two-Higgs-doublet 
model, a subset of the full 3-3-1 model. We find that the additional 3-3-1 
physics weakens the bound on the charged Higgs mass from Mjj+ > 290 GeV 
to M h + A 120 GeV. 
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I. INTRODUCTION 


Since most indirect effects of new physics first enter at the loop level, they are often 
dominated by tree level Standard Model (SM) contributions. It is for this reason that only 
now, with the advent of precision electroweak measurements, we are beginning to probe the 
structure of new physics. However an exception to this approach is the process b sy. 
Since this Flavor Changing Neutral Current (FCNC) process first occurs at loop level in the 
SM, we have an interesting case where the effects of new physics may be comparable to the 
SM contribution. 

On the experimental side, CLEO has recently announced a measurement of the inclusive 
decay rate [[TJ 

BR {b -> sy) = (2.32 ± 0.51 ± 0.29 ± 0.32) x 10“ 4 , (1.1) 

where the final two errors are both systematic in nature. This translates into 

1 x 10“ 4 < BR (b -> sy) < 4 x 10“ 4 , (1.2) 

at the 95% confidence level. While there are still substantial theoretical uncertainties in the 
SM prediction for b —» sy (mostly related to unknown next leading order QCD corrections 
0), this experimental value agrees well with a standard model prediction of (2.75 ± 0.80) x 
10 ~ 4 with a top quark mass m t = 175 GeV |2| [5|. 

The sensitivity of this FCNC process to new physics thus allows us to put limits on 
many theories of physics beyond the SM ||. In this paper we examine the implications 
of the b —> sy penguin on the 3-3-1 model ||. This model, based on the gauge group 
SU(3) C x SU(3)l x U(l)x, gives a potential answer to the question of flavor by predicting 
three families as a consequence of anomaly cancellation. This is accomplished by making one 
of the three quark families transform differently from the other two under the SU(3)l x U(1)x 
extended electroweak gauge group. Hence this model suffers generically from large FCNCs 
|i| ||, leading to a possible large enhancement of the b sy decay rate. 

While the 3-3-1 model predicts no new leptons, it predicts one new quark per family, 
denoted here by D and S with charge —4/3 and T with charge 5/3 |J. These quarks 
interact with the ordinary quarks via the charged dilepton gauge boson doublet, (F' ++ , Y + ). 
In addition, there is a neutral Z’ gauge boson with flavor changing couplings to the usual 
quarks. Thus there are new processes contributing to b —> sy incorporating H-new quark 
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loops as well as flavor changing Z' loops. Although many Higgs multiplets are necessary in 
order to break the 3-3-1 gauge symmetry, we show that it is only necessary to look at an 
effective two-Higgs-doublet model. 

An unusual feature of the 3-3-1 model are the strong bounds placed on the masses of 
the new particles. Of present interest is the bound 300 < My < 1100 GeV H[10| which 
indicates that the 3-3-1 contributions to 6 —> sy may not be suppressed by simply increasing 
the 3-3-1 scale, My. 

As is well known, QCD corrections lead to an important enhancement of the b —» sy decay 
rate in the SM. Thus, when examining the additional contribution from the 3-3-1 model, 
we divide the calculation into two parts. In section 2, we calculate the new electroweak 
penguin diagrams associated with the 3-3-1 model, and in section 3, we examine the effects 
of QCD running from the 3-3-1 scale to 6-quark scale. In section 4 we combine the results 
of the previous sections and examine the implications of the current CLEO bound on the 
3-3-1 model. Finally we present our conclusions in section 5. 


II. ELECTROWEAK PENGUINS IN THE SM AND 3-3-1 MODEL 

Although the 3-3-1 model contains tree level FCNC interactions mediated by Z' exchange, 
the decay 6 —> sy remains a loop process in this model. Thus we expect the additional 3-3-1 
contributions to 6 —» sy to be at most comparable to the SM penguin diagram. These new 
3-3-1 contributions arise from dilepton gauge boson Y, Z' and charged Higgs loops. At 
one-electroweak-loop order, all these contributions add linearly to the 6 —> sy amplitude. 
Hence we consider them one at a time. 

In the gauge sector all lowest order contributions to 6 —> sy are given by the penguin 
diagrams of Fig. |l] where V = W, Y or Z'. Since all charged gauge bosons contribute 
similarly, we first calculate the effective 6 —> sy vertex for an arbitrary left handed gauge 
boson loop and subsequently specialize to W or Y loops. The Z' contribution is calculated 
separately since it involves flavor changing vertices. 

For a left handed gauge boson V, the diagrams of Fig. |I] give rise to an effective vertex 

r _a _ 

M 6 4ns 2 2M?: 


v 


(l In - In 4)Fi(q ) + (iann<f A + (q )J 7 L b, 

( 2 . 1 ) 


where q M is the momentum carried by the photon. While gauge invariance of the photon 
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demands a vanishing F llAb , we will see that this arises in a subtle manner in the 3-3-1 model. 
We work in Feynman gauge and ignore the light quark masses. Then, for a single fermion 
of mass m in the loop, we find the on-shell form factors 


Fi(0) = Q 


1 x{x 2 + llx — 18) — 9x 2 + 16x — 4 
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where x = m 2 /M 2 . For later convenience, we have defined the functions 


fi(x) 

h{x) 


x(x 2 — 5x — 2) 3 x 2 

___ L -|-In x 

4(x — l ) 3 ' 2 (x — l ) 4 

x(—2x 2 — 5x + 1) 3 x 3 

— 1 - ! j -In T 

4(ar — 1)3 2(a;—l) 4 


(2.3) 


In the above form factors, Q is the charge of the fermion in the loop and Qy is the charge 
of the gauge boson. In the SM, only the W loop is present, in which case Q = 2/3 and 
Qy = —1. After summing over all three families, the constant terms in Eqn. (|2.2|) vanish 
by the GIM mechanism while the non-constant terms agree with the expressions given by 


Inami and Lim [ITT 


Prior to imposing the GIM mechanism, the gauge non invariant term _p nAb is present. 
In Feynman gauge, to the same order as above, we find 

-2 


-tnAb 


(? ) = 2 ( 3v 


Am + 


Q 


6 M 2 


+ ••• 


(2.4) 


where Am = - —7 — In in dimensional regularization. We note that F nAb is independent 
of the mass m of the quark propagating in the loop. Thus, assuming generation universality 
as in the case of the SM, it drops out of the final expression because of the GIM mechanism. 

When we take QCD corrections into account we need to calculate the induced b —> sg 
penguins as well. The above form factors are also valid for the gluon penguin provided we 
set Q=1 and Qy = 0 and replace e by the strong coupling g^T 11 . For on-shell interactions, 
Fi is unimportant and we are left with the dipole terms given by F 2 . By convention, we 
now denote the coefficient of such photon and gluon dipole terms by C 7 and Cg respectively 
Q. I 11 the case of a IF loop, we take the GIM mechanism into account and assume a heavy 
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top quark. In this case the photon and gluon dipole coefficients become^ 


Cj M (M w ) 

c! m (m w ) 


\v t y tb 


r:/i (■'■■<) 


h(xt ) 


■y;,v tb Mx t ) , 


(2.5) 


where — m^/M bv . This is the only contribution in the SM. 

In the 3-3-1 model, we need to include the contributions from the dilepton-heavy quark 
loops. In this case, there is a generalized GIM mechanism which replaces the standard 
case in the SM. Denoting the unitary mixing matrix in the down quark sector by Vl with 
elements f?|, we sum over all three families (exotic quarks D , S and T ) to fold 


C'f(M) 


y, 


Cl (il/h 


= -lj2 v is v ib 

z i =i 


-g/l(^) + f2(Xi) 




2 + 3fi( x s) — 3f 2 (x 3 ) 


Y, 


z j=l 


( 2 . 6 ) 


where Xi = rriQ./My and Qi = (D,S,T). Unlike the SM contribution, where we ignore 
masses of the first two families, in this case phenomenology dictates that all exotic quarks 
are heavy. The gluon penguin has the same form as in the SM since QCD is insensitive 
to the electric charges of the quarks and gauge bosons in the loop. On the other hand, 
the second line in Eqn. (|2.6|) is present because the third family couples differently. This 
is already well known for the tree level Z' couplings. However we see here that generation 
non-universality also appears in dilepton loop diagrams. 

We note that this imperfect GIM cancellation has a couple of consequences. First of all, 
unlike the SM, the dilcpton induced b —» sy penguin in the 3-3-1 model may be non-vanishing 
even when all exotic quarks are degenerate in mass. This is simply another manifestation of 
potentially large FCNCs in the 3-3-1 model. Secondly, we may worry about the divergent 
gauge non-invariant term F llAb of Eqn. O- Because the GIM sum involves the gauge 
bosons Y + and Y , we fold a left over divergent term of the form — 3v^ s v 31) [Am + q 2 /6M 2 ]. 
This, however, is cancelled by the Z' FCNC vertex induced by 'y-Z' mixing as shown in Fig. |2| 


1 In this section we include the CKM factors explicitly. However subsequently they will be absorbed 
into the definition of the effective Hamiltonian. 
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T2| . Since this diagram does not contribute to the dipole form factor, its only purpose for 
the present discussion is to eliminate the unwanted F n , and can otherwise be ignored. 

Finally, the diagrams with a Z' in the loop also contribute to b —> sy due to the flavor 
changing Z' couplings. In this neutral current case, since the quark in the loop is light, we 
ignore its mass and find 


C?(M Z ') = ~C*\M Z ,) 


1 


(2.7) 


where s 2 = 1 — c 2 = sin 2 arises from the Z' coupling to quarks [|Jl3]]. In principle, this 
introduces yet another scale into the problem, namely M Z i. Since the Z' is considerably 
heavier than the dilcptons, we would in principle need to worry about all three heavy scales, 
Mz', My and Mw (in addition to heavy quark thresholds) when including QCD corrections. 
However, as a simplification we ignore the difference between the two 3-3-1 scales since the 
QCD running effects are less pronounced at higher energies. In this case, we find it convenient 
to rewrite the Z' contribution to change the mass scale in the effective vertex, Eqn. (0). 
from M Z ' to My. Using the relation M§, = My/p 3 _ 3 _ i sin 2 # 3 _ 3 _i where cos 2 # 3 _ 3 _i = 3 tan 2 9w 
TCfl , we arrive at 

1 


Cf (My) = --cf (My) 

1 —16 S 2 

Ci (My) = -~v’ 3 ,V 3b — 


( 2 , 8 ) 


As in the SM, the generalized rho parameter, p 3 _ 3 _i, depends on the specifics of the extended 
Higgs sector. p 3 _ 3 _i = 3/4 in the minimal 3-3-1 model where SU(3)l x U( 1)x is broken by 
a single SU{3) L triplet Higgs VEV |10 . 

In addition to the gauge boson loop contributions, additional scalars may also induce a 
b —> sy dipole transition. The reduction of the minimal Higgs sector of the 3-3-1 model has 
been considered in [|Hj. Three SU(3)l triplet and one sextet Higgs fields are required to 
break the symmetries and generate all fermion masses. While the general Higgs structure 
is quite complicated (and includes flavor changing neutral Higgs interactions), we make 
the assumption that only interactions proportional to the (large) top Yukawa coupling are 
important. Along this line, we note that the minimal 3-3-1 Higgs sector reduces to a three- 
Higgs-doublet SM with additional fields carrying lepton number. In the quark sector, this 
reduces further into a two-Higgs-doublet model with the added feature that the couplings 
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of the two Higgs doublets to the third family are interchanged compared to the first two 
families. 

Assuming an approximately diagonal family structure, since only loops involving the top 
quark are important, we only consider the third family Higgs boson couplings. In this case, 
the scalar contribution is equivalent to that of an ordinary two-Higgs-doublet model (at this 
level of approximation), with the well known result 


C™(M W ) 

C™{M W ) 


v; s v tb 


;h(yt) - / 2 ( 2 /i) ) cot 2 /5 


~Q V ts V tb 


fi(Vt) cot 2 (3 - f 3 (y t ) 


(J h(yt ) - MvSj 


(2.9) 


where 


h{y) = 
U (y) = 


3y(-y + 3) _ 3 y 

2 ( 2 / - l) 2 (y — l) 3 

32 /( 2 / + 1 ) 3// 2 


In y 
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( 2 . 10 ) 


2 ( 2 / - I) 2 (y — I) 3 

In this case, y t = m 2 /M‘f 1+ and tan/3 = v 2 /v\ where v 2 gives rise to m t . 

The complete clectroweak contribution to b —> sy in the 3-3-1 model is simply a sum of 
the individual contributions given in Eqns. 


, (pD, (p|) and (pD 


M, 


Ci(M w ) = C?“(M W ) + C~ HD (M W ) + -j£p> (My) + Cf (M,-)) ■ 


( 2 . 11 ) 


This shows explicitly that the 3-3-1 contributions are suppressed by the higher dilepton mass 
scale. Nevertheless, as shown in the next section, the 3-3-1 coefficient Cj (My) is quite large 
because of the family non-universality. This and the upper bound on My ensure that the 
new 3-3-1 effects are generally of the same order as that of the SM and cannot be ignored. 


III. THE EFFECTIVE HAMILTONIAN AND QCD CORRECTIONS 

In the SM, the QCD corrections to b —> sy soften the GIM mechanism to yield a loga¬ 
rithmic GIM cancellation. This effect leads to an enhancement of the b —> sy rate of about 
a factor of three. For the 3-3-1 model, however, the generalized GIM mechanism present in 
dilepton exchange diagrams, Eqn. (|2.6|) , is imperfect, even in the absence of QCD correc¬ 
tions. Thus in this case, additional QCD corrections are not expected to dominate the 3-3-1 
contribution to b —> sy. Nevertheless, we include them here for completeness. 
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We deal with the QCD corrections using the standard technique of integrating out the 
heavy degrees of freedom at each scale, using the renormalization group approach with 
effective hamiltonians. We work with three scales, m &, M w and My, where the latter two 
can also be thought of as the electroweak and the 3-3-1 scales respectively. Starting at My, 
we first integrate out the 3-3-1 degrees of freedom, and then at Mw integrate out the W and 
top simultaneously 2 . Since the running between Mw and m 5 has been extensively studied, 
we use the well known results of the leading order calculation ft|. [TTi| . [T7| and generalize them 
to take into account additional operators present in the 3-3-1 case. 


A. The effective Hamiltonian for Mw < /i < My 


Below My, we integrate out both dilepton and Z' loops, yielding an effective Hamiltonian 


- tl / 3 - 3-1 _ 0,/or 

--2V2 G F j^ 


'i'-'ii, VC’ ’ 1 f/0 , 


(3.1) 


where the set of operators Of" 3 " 1 consist of both four-Fermi and penguin operators relevant 
to the flavor changing A B = — AS = — 1 interaction. Since the 3-3-1 model has additional 
FCNC interactions, we must use the extended operator basis 


o\ = (s La 'r lx t p L ){t LP Yb ( l) 

0\ = 

0\ = (s L 'y f j,b L )(b L 'y% L ) 

O 3 = (s L ^b L ) 

Q 

O 4 = {s La ^y L ) Yl(QL{tY<1 l) 
<1 

Os = 0 l7A) 

0 6 = (s Lq 7X) 

0 5 Q = (sL/ lt b L ) Y YSrii'qR) 


2 In principle, there are additional corrections arising from QCD running between mt and Mw 
[ 14,151. However such corrections are presently dominated by the uncertainty arising from QCD 
scale dependence in the leading order calculation and may be ignored. 











O6 = (s L a'yy L )J2 e <l( ( lR0'y fl( lR) 
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0 7 = j^rnbisLcr^ub^F^ 

°s = ^ 2 m b (s L a, u T a b R )G a ^ . (3.2) 


Color non-singlet channels are indicated explicitly via the color indices a and f3. Since we 
are effectively above rrit, the sums are over all six quarks. 

The Wilson coefficients, U 3 " 3 ' 1 (My), are given by the matching conditions at the 3-3-1 
scale. Integrating out the dileptons and exotic quarks gives rise to the penguin operators 
as shown in the previous section. Integrating out the Z’ gives rise to effective four-Fermi in 
addition to the penguin operators. To leading order, the non-zero Wilson coefficients are 


C^-\My) 

C^ 3 - 1 (M y ) 

CIq\M y ) 

c 3 ~ 3 -\m y ) 
c 3 - 3 -\m y ) 


2 

gP3-3-1 
2 

0P3-3-1 

1 2s 2 

77P3-3-1-; 


2/?3-3-l 

C Z 

9 8 s 2 

4 " 27 P3 - 3 -^ " 


f/i(*s) - \h(xs) 


+ 


XP 3 - 3-1 + \ Ifl(xs) ~ fl(x T )] , 

9 c z 2 


X fl(x T ) + f2(x T ) 

O 


(3.3) 


where xs = m 2 s /M Y and x Y = m Y /M Y . We have assumed negligible mixing to the first 
family so that v* ls v 2b ~ ~ v *i s v 'ib- This is also the reason why the exotic D quark does not 
appear. Although we take P 3 - 3-1 = 3/4 for our numerical results, it is shown explicitly above 
to indicate that those terms are due to Z' exchange. 

The Z' induced terms arise where one vertex gives the b —> s flavor changing interaction 
and the other vertex is flavor conserving. However, since the left handed Z' interaction is 
non-universal, it singles out one of the families for special treatment. Up to small mixing 
(which we ignore), it must be the third family which is why the third family operators 
0\ and 0\ are singled out. The other new four-Fermi operators, O b and O g , must 
then be included to account for operator mixing as well as the right handed Z' vertex. It is 


straightforward to extend the results presented in |HJ to determine the anomalous dimension 
matrix corresponding to the mixing of the operators in Eqn. (|3.2|) . The results are shown in 
the Appendix. 
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In order to examine the significance of the additional 3-3-1 contributions to b —> s 7 , 
we show values for the initial Wilson coefficient Cf - 3 - 1 (My) in Fig. [|. From the figure, it 
is obvious that the generalized GIM mechanism is quite different from the ordinary case. 
Instead of vanishing as in the usual case, the Wilson coefficient takes on its largest values 
when the exotic quarks are relatively light and degenerate in mass. Since the functions f\ 
and / 2 are bounded by 0 < fi(x) < 1/4 and —1/2 < / 2 (x) < 0, we find the limits 

1.06 < C 3-3-1 (iffy) < 2.18 

0.076 < G| - 3 - 1 (M y ) < 0.326 , (3.4) 

although for realistic values of 777.5 and m T , we expect a more limited range, 1.3 < 
CV 3-3-1 (M y ) < 2.0 as indicated by the figure. Note that this may be contrasted with the SM 
value Cy M (M w ) ~ —0.20 for m t = 175 GeV. After accounting for the additional M^/My 
factor in Eqn. ( |3.1|) that arises from the difference in mass scales, we see that the new 3-3-1 
effects are comparable to that of the SM. 

B. The matching conditions at M\y and 7i e s for < /U < Mw 

When we reach the electroweak scale, Mw , we further integrate out the top and W. In 
this case, we match the effective hamiltonian 7f 3 j T 3-1 (Mvy) onto a second one, 7f e fi, without 
the top degrees of freedom. At this stage, since we include the SM contributions to b —> sy, 
we choose the conventional form 


H eS = -2V2G F V t * s V tb Y,Ci(v)0(ri . (3.5) 

i 

However, since we have included a larger set of operators in Tf 3 ^ 3 " 1 , they must be retained 
when running to mi. Thus a complete set of operators below M\y consist of those of 
Eqn. (|3.2|) , with the exception that 0\ and O l 2 are replaced by the conventional operators 

Oi = (s La ^(P L )(c L p^b1) 

0 2 = (si, 7 At c L )(c L 7 M 6 L ) , (3.6) 

and we only take five active quarks in O 3 through O®. 

At Mw, the Wilson coefficients get contributions both from integrating out the top and 
from matching onto 7f 3 k 3-1 - We find 
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Ci(M w ) = C™ bsm (M w ) 

C 2 (M w ) = C 2 HDSM (M w ) 

M 2 

Ci(M w ) = C™ dsm (M w ) + X^rwCf~ 3 ~ 1 (M w ) (all other operators) , (3.7) 

IViY 

where x — v t s v ?,bl^ts^tb i s the ratio of 3-3-1 and SM mixing angles. The SM coefficients 
include the contributions from the two-Higgs-doublet model and are given by 


C'| hdsm (M vk ) 

C 7 2HDSM (M w ) 

Cf hdsm (M w ) 


r/i(®t) - h( x t) 


fi(Vt) - f 2 (vSj cot 2 /? - Qfsivt) - Mvt) 


-^AOu) 


1 r 
6 - 


A(j/t) cot 2 f3- f 3 (y t ) 


(3.8) 


IV. THE 6 -*• S7 RATE AND LIMITS ON 3-3-1 PHYSICS 


Once the 3-3-1 and SM matching conditions, Eqns. ( fh3| ) and (|378|), are given, it is 
straightforward to solve the renormalization group equations to arrive at Cr(fj). The b —> sy 
decay rate is then calculated in the ratio 


r(6 - « 7 ) \v t ;v t 


tb I 


6 a 


| Kb | 2 7r/(z) 


\CtM 


(4.1) 


T(6 —>■ ceV e ) \v cb \ 

where z = m c /m b and I(z) — 1 — 8 z 2 + 8z 6 — z 8 — 24z 4 In z is the phase space factor for the 
charged current decay; I(z) = 0.485 ± 0.028 for z = 0.316 ± 0.013 Following [@], we do 
not include the 0(a 3 ) corrections to b —> ceT e at this order. I 11 the absence of a complete 
next to leading order calculation, when necessary we vary the renormalization scale fi by a 
factor of two around m b to estimate the effects of the QCD scale ambiguity . The resulting 
large /i dependence of the leading order calculation is the dominant theoretical uncertainty 
in the predicted b —> sy decay rate. 

Using the current value for the charged current decay mode, BR (6 —*• ceV e ) = (0.104 ± 
0.004) [R|, Eqn. (fl.l| ) may be rewritten as 


BR (b -> sy) = (2.84 ± 0.23) x 10“ 3 |CV(/i )| 2 
so that the current CLEO limits, Eqn. O. correspond to 


(4.2) 
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0.18 < \Cf{n )| < 0.38 (CLEO) . 


(4.3) 


From now on we focus on CV(/x) instead of the branching ratio since the SM W-t, H + ~ 
t and new 3-3-1 contributions may simply be added together in the amplitude (this will 
always be true, even with higher order QCD corrections, as long as we work only at the 
one-electroweak-loop order). 

The 3-3-1 model introduces many new parameters into the b —» sy calculation. Explicitly, 
we write 


C 7 (n) = C 7 (n; m t , M h + , tan /3; m s , m T , M Y , y) 

= (7y HDSM (/i; mt, M H +, tan/3) + AC 7 (/x; m s , m T , M Y , x) , (4-4) 


where in the second line we have separated out the two-Higgs-doublet SM and new 3-3-1 
contributions. The SM prediction for C 7 {rn b ) is shown by the solid line in Fig. f| along with 
the CLEO bounds. We have taken a 3 (M z ) = 0.120 and m b = 5 GeV. As can be seen, the 
present experimental data is consistent with the unadorned SM. When the charged Higgs 
loop is included, it always contributes with the same sign and hence can only increase the 
predicted branching ratio. As an example, we plot C 7 (m b ) for several values of the charged 
Higgs mass in Fig. [I] (dotted lines) when tan f3 = 3. The two-Higgs-doublet results are fairly 
insensitive to tan/3 provided tan/3 1. For small tan/3, on the other hand, the charged 
Higgs contribution is enhanced and often falls outside the CLEO bound. 

The effect of the 3-3-1 contributions, AC 7 (mb), may be estimated from the renormaliza¬ 
tion group analysis as 


Mi 


Ml 


A C 7 (m b ) « x^-ttt °- 063 + 0.59 Cf^\M Y ) + O.llCf^(My) 


- y 3 - 3 - 1 / 


(4.5) 


using 400 GeV as the 3-3-1 scale. Since both Wilson coefficients are bounded according to 
Eqn. (|3.4j), we find the size of the new 3-3-1 effects to be 


Mw, 


AC 7 (m 6 )«x^|(0.7-1.4) 


(4.6) 


This range is given by the dotted lines in Fig. |5|. assuming y = 1. The actual predictions 
for degenerate exotic quarks are given by the solid lines in the figure. 

While the mixing parameter, y = v* is v :ib /V t *V tb is in principle undetermined, we expect 
both the numerator and denominator to be comparable, giving a value |y| ~ C(l). Unre¬ 
alistic cases of vanishing mixing in the down quark sector (V 7 = 1) and up quark sector 
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( Ul = 1) give x = 0 and 1 respectively. In order to put an experimental limit on x> we 
may use the neutral meson mixing data to restrict the product of 3-3-1 mixing angles to be 
1^35%; I < 0.25 at 90% C.L. [0], This gives the bound |x| < 8.3, although values near the 
upper bound may be somewhat unnatural from a theoretical point of view. 

As in the two-Higgs-doublet model, the additional contribution from the 3-3-1 model, 
ACV(/i), always enters with the same sign. However, unlike the charged Higgs contribution 
which always increases the b —> sy rate, the effect of the new 3-3-1 contribution depends 
on the quark mixing parameter From Eqn. O we see that x > 0 (< 0) leads to 
a suppression (enhancement) of the overall b —» sy decay rate. In general, when x is 
complex, the results lie somewhere in the middle. This feature seems to be shared with 
other models incorporating two Higgs doublets. Namely, while the charged Higgs loop alone 
always increases the b —> sy decay rate, the additional new particles, whether superpartners 
in the SUSY case or dilepton gauge bosons in the 3-3-1 model, contribute with arbitrary 
sign and may compensate for the increase arising from the Higgs loop. This is also the case 
for radiative corrections to the Z —>■ bb vertex. 

In order to examine how the new 3-3-1 physics weakens the b —> sy limits on the pure 
two-Higgs-doublet model, we plot the allowed region in the tan (3-M H + parameter space 
in Fig. |]. In this case we have fixed the top quark mass to be 175 GeV. The solid line 
corresponds to the two-Higgs-doublet model and shows that M H + > 290 GeV for the case 
m t = 175 GeV. In arriving at this limit we have estimated the theoretical uncertainty by 
varying the QCD scale p from mb/2 to 2 mb- As noted previously, the limits are insensitive to 
tan/3 when tan/3 > 1. Inclusion of 3-3-1 physics with |y| < 1 lowers this bound as indicated 
by the dotted lines in the figure. For a dilepton gauge boson mass M y = 300 GeV, the 
corresponding limit on the charged Higgs mass is weakened to M H + > 120 GeV for light 
exotic quarks. The 3-3-1 limits correspond to real positive y, which is the region of maximum 
cancellation between the charged Higgs and dilepton gauge boson loops. Larger values of 
y naturally weaken the limits further. However the further we are below the two-Higgs- 
doublet limit (solid line), the more tuning is required between the two-Higgs-doublet and 
3-3-1 parameters to achieve large cancellations. Thus from a naturalness point of view, we 
expect the charged Higgs mass in the 3-3-1 model to be no lighter than ~ 120 GeV. 
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V. CONCLUSION 


Because it is a loop process, the FCNC decay b —> sy presents an interesting test of both 
SM and new physics. In the SM, this process is GIM suppressed and proceeds through a 
heavy top quark. While the theoretical calculation suffers from large uncertainties due to 
unknown next to leading order QCD corrections, it is in excellent agreement with the current 
CLEO data [|T[. Nevertheless, at the present level, the results are not yet sensitive to m t in 
the SM, as may be seen from Fig. £|. Future work, on both the theoretical and experimental 
side, may bring the uncertainties down to the point where b —> sy would become more 
sensitive to both m t and new physics. 

In anticipation of such future improvements, we may estimate the size of the contribution 
of new physics to b —> sy. Compared to the SM value, C 7 (m?,) ~ —0.3, new physics 
at a scale M new is expected to contribute roughly to the b —> sy vertex as \5C 7 (mb)\ ~ 
(Af^/Af„ ew ) (AMq/M^ ew ) where A Mq is a typical mass splitting between the new fermions 
in the loop and arises via a generalized GIM mechanism. Thus in general (assuming the 
absence of tree level FCNCs in the extended model) new physics is suppressed by both the 
heavier mass scale and a generalized GIM mechanism and is hence dominated by the larger 
SM contribution. 

I 11 order to evade this conclusion, we need to either have M new ps Mw or somehow avoid 
the generalized GIM cancellation. An example of the former case is the two-Higgs-doublet 
model where a light charged Higgs particle may be eliminated by the current CLEO data. As 
an example of the latter case, we have performed a detailed calculation of b —> sy in the 3-3-1 
model. Due to the different representation of the third quark family, the generalized GIM 
cancellation is imperfect and \AC 7 (mb)\ ~ M^/My is non-vanishing even for degenerate 
exotic quark masses. Compared to the two-Higgs-doublet model where M H + > 290 GeV, 
this limit is weakened to M#+ > 120 GeV in the full 3-3-1 model. 

Although the 3-3-1 model appears tightly constrained both by FCNC limits and by the 
large U{l)x coupling mm, the model survives the test of b —> sy, at least up to the 
current level of precision. As experimental evidence for a heavy top continues to build, the 
curious feature of a different third generation in the 3-3-1 model takes on more significance. 
Hence we look forward with anticipation to what future experiments in the B system will 
bring. 
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APPENDIX: THE ANOMALOUS DIMENSION MATRICES 


At leading order, the renormalization group equation for the Wilson coefficients C(fj) is 


where 


= [7 T (r)] C(fi) , 


/ \ a 3(A) o 

7(A) = —7 . 


(Al) 


(A2) 


and a 3 (/i) = g 3 (/r)/ 4n satisfies the /3-function equation 

d -if \ _ b 
(/i) 2 tt ’ 


(A3) 


Here b = — 11N/3 + 2//3 is the one-loop QCD beta function coefficient for / quarks (b( 6 ) = 
—7 and b( 5 ) = -23/3). Eqn. ([ATT) is exactly solved by 


C(m) = v 


V 






(A4) 


where 7] = a 3 (M)/a 3 (/i). For consistency at this order, the running of a 3 (/x) is only calcu¬ 
lated to one loop. In this notation, 7 ^ = V~ lr j 0T V is the diagonal matrix of eigenvalues of 
7 0 . 


For the extended operator basis of Eqn. (|3.2|) , we write the scheme independent anoma¬ 
lous dimension matrix in the form 


7 = 


744 74P 


0 7 pp , 

Then, for u up and d down type quarks, we find 


(AS) 
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(A 6 ) 


the penguin operators are given by 


/ 4C 2 0 \ 

7 pp — ( ) • (A7) 

V-i(4C 2 ) 8C 2 -2NJ 

For 74 p, we use the scheme independent formalism of (T^J (which, at this level, is equivalent 
to using the’t Hooft-Veltman regularization scheme). The result is 


/ 0 

3S 2 

(3e u + ^e d )C 2 

§c 2 -n 

(3 + | )e d C 2 

3S 2 + fC 2 -N 

2(3 + |)edC 2 

3fS 2 + 2(f C 2 - N) 

(3 7 + | fe d )C 2 

6S 2 + f(fC 2 - N) 

—4 e d C 2 

—3fS 2 — 4C 2 + N 

(-37 + | fe d )C 2 

—4S 2 + f(-fC 2 + f) 

-4 e 2 d C 2 

—3fS 2 + e d (— 4C 2 + iV) 

K (-3 (ue 2 u + de 2 d ) + | le d )C 2 

— 4e ( i*S' 2 + f{-^-C 2 + y) 


(AS) 


where S 2 = 1 / 2 . 

For Mw < /U < My, we set N = 3 and six quarks are active (u — d — 3). In this case 
the explicit anomalous dimension matrix is 
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Below M w , the top quark is integrated out, and we are left with a five quark anomalous 
dimension matrix 
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(A10) 
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FIGURES 

FIG. 1. The gauge boson contributions to b —> sj. In the 3-3-1 model, V may be either W , Y 
or Z'. 

FIG. 2. Additional diagram needed to cancel divergences and restore gauge invariance in the 
b —> sy vertex in the 3-3-1 model. 

FIG. 3. Contours of constant C' 3 ' 3 ' 1 (My) in the xt~xs plane. Note that C' 3 ' 3-1 (My) is every¬ 
where positive and does not vanish on the diagonal xt = xs- 

FIG. 4. The Wilson coefficient CV(m{,) in the SM (solid line) and two-Higgs-doublet model (dot¬ 
ted lines) plotted as a function of m*. For the two-Higgs-doublet model, we have taken tan/? = 3. 
The current CLEO bounds are shown by the dashed lines. 

FIG. 5. The 3-3-1 model contribution to CV(m{,) (with the mixing parameter x removed) plotted 
as a function of dilepton gauge boson mass for degenerate exotic quark masses mQ = 250, 500, 750 
and 1000 GeV (solid lines). The dotted lines indicate the minimum and maximum possible values 
arising from 3-3-1 physics. 

FIG. 6. The allowed region in tan (3-M H + parameter space for the two-Higgs-doublet model 
(solid line) and the 3-3-1 model (dotted lines). For each pair of dotted lines, the upper one 
corresponds to Mq = 1000 GeV and the lower one to Mq = 250 GeV. For the 3-3-1 model we have 
restricted the ratio of mixing angles by |x| < 1. 
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Figure 2 
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